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During  the  contract  period  we  made  considerable  progress,  developing  new  families  of 
convex  optimization  problems  for  use  in  control  engineering,  forging  new  areas  of  control  ap¬ 
plications,  and  improvements  in  algorithms.  At  the  same  time,  control  engineering  methods 
based  on  LMIs  and  SDP,  the  bases  for  which  were  developed  during  the  previous  AFOSR 
contract,  have  been  very  widely  adopted  and  used. 


Research  Summary 

Detailed  descriptions  of  our  research  accomplishments  have  been  published  in  archival  jour¬ 
nals  or  books,  or  submitted  to  journals  and  made  available  at  Professor  Boyd’s  web  site, 

http : / /www-isl/people/boyd/ 

Several  software  packages  developed  under  this  research  contract  have  also  been  made  avail¬ 
able  via  WWW.  Therefore  this  comprehensive  summary  of  the  work  and  accomplishments 
will  mostly  refer  to  papers  or  software  that  are  available  elsewhere. 

Our  survey  paper  on  semidefinite  programming,  [VB96],  appeared  in  SIAM  Review  and 
has  been  extremely  widely  read  (and  cited)  by  researchers  in  control,  statistics,  applied 
mathematics,  and  many  other  areas,  as  well  as  engineers  in  many  areas  of  control  engineering. 

Other  papers  related  to  various  theoretical  and  computational  aspects  of  SDP  are  [VB98, 

BV96,  VB95]. 

We  developed  a  new  family  of  optimization  problems  involving  determinant  maximization 
with  LMI  constraints  (abbreviated  CP  in  the  book[BEFB94]).  These  problems  arise  in  many 
problems  of  system  and  control,  especially  those  involving  extremal  ellipsoids,  maximum 
entropy,  central  Hoo  controllers,  and  so  on.  We  wrote  a  paper  on  the  topic,  (which  will  ap¬ 
pear  in  SIMAX)  that  covers  the  theory,  algorithms,  and  details  many  applications[VBW98]. 

We  developed,  tested,  and  released  a  complete  software  package  for  solving  maxdet  prob¬ 
lems  (MAXDET),  and  incorporated  this  new  solver  into  SDPSOL,  a  new  parser/solver 
for  solving  problems  involving  matrix  inequalities  (and  now,  determinant  maximization) 

[WB96b,  WB96a,  WVB96].  MAXDET  has  been  used,  by  us  and  others,  for  a  wide  variety 
of  problems  ranging  from  controller  synthesis  via  V-K  iteration,  to  obstacle  and  collision  de¬ 
tection  in  robotics  [RB96,  RB97],  to  optimal  frequency-domain  experiment  design[JBK+96]. 

Like  linear  matrix  inequalities  and  semidefinite  programming,  maxdet  programming  will  be¬ 
come  another  standard  tool  for  control  engineers.  The  paper  and  code  have  been  widely 
used  and  cited  [WBV96,  VBW98]. 

We  developed  a  preliminary  second  (sparse)  version  of  our  original  semidefinite  programming[VB96] 
code  SP,  and  made  it  available  via  WWW.  The  more  efficient  handling  of  the  large  sparse 
problems  arising  in  control  allowed  the  code  to  be  used  in  several  new  control  applications 
at  universities  and  companies,  e.g.,  Kevin  Wise’s  group  at  McDonnell  Douglas.  Perhaps 
the  best  news,  however,  from  the  point  of  view  of  computational  algorithms  for  semidefinite 
programming  and  linear  matrix  inequalities,  is  the  extraordinary  on-going  effort  in  the  opti¬ 
mization  community  to  develop  extremely  high  performance  SDP  codes.  The  interest  in  the 
optimization  community  is  due,  in  part,  to  work  (by  many  researchers)  on  LMIs  and  SDPs 
in  control.  The  next  generation  of  codes  are  just  now  becoming  available  and  will  give  yet 
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another  large  efficiency  gain.  One  of  our  main  goals  —  wide  and  common  use  of  LMIs  and 
SDPs  in  control  —  is  already  starting  to  be  achieved. 

We  also  completed  our  work  on  another  new  family  of  convex  optimization  problems  that 
arise  in  control  —  second-order  cone  problems  (SOCP).  A  major  paper  on  this  topic  was 
prepared  and  accepted  by  Linear  Algebra  and  Applications  [LVBL97].  In  this  paper  we  work 
out  most  of  the  theory,  and  introduce  a  large  number  of  new  applications  in  control  and 
other  engineering  fields.  We  developed  and  tested  an  interior-point  code  (SOCP[LVB97]) 
for  this  problem,  and  released  it  via  WWW.  This  code  is  also  already  widely  used  and 
cited.  Moreover  other  packages  for  convex  programming  (e.g.,  SDPPACK[AHN+97])  have 
incorporated  SOCP  as  a  new  basic  problem,  citing  our  paper. 

We  pursued  a  number  of  applications,  for  example,  a  new  method  for  FIR  filter  design 
using  spectral  factorization  and  convex  optimization [WBV96,  WBV97,  WPB96],  which  we 
will  continue  next  year.  For  model  predictive  control,  we  introduced  the  idea  of  using  robust 
open-loop  programming  via  SOCP  to  develop  robust  control  laws  that  incorporate  ellipsoidal 
confidence  bounds.  This  work  was  reported  in  two  plenary  lectures  (in  Banff  and  in  Seoul) 
and  appears  in  the  paper[BCH97]. 

We  have  extended  new  sophisticated  methods  of  global  optimization  used  for  nonconvex 
quadratic  programming  to  the  BMI  problem:  primal-relaxed  dual  global  optimization  (see, 
e.g.,  [FV93]).  Initial  results  are  very  encouraging,  and  were  reported  in  the  European  Control 
Conference[BVB97,  BG96]. 

We  have  also  developed  a  new  method,  based  on  linear  matrix  inequalities,  in  VLSI 
circuit  synthesis[VBE96,  VBE97,  VBE98].  These  are  essentially  control  problems  with  time 
constants  at  or  below  the  nanosecond  level.  The  “controller”  parameters  are  the  widths  of 
wires  and  transistors  in  the  circuit,  and  speed  of  response  translates  directly  into  achievable 
clock  rate,  i.e.,  processing  speed.  Other  important  objectives  include  average  power  and  total 
area.  Prom  the  mathematical  point  of  view  the  most  important  feature  is  that  the  open- 
and  closed-loop  systems  are  symmetric  —  i.e.,  governed  by  diffusion  dynamics.  For  such 
systems,  complete  (controller)  parameter  design  is  possible  via  LMIs  and  SDP.  There  are 
many  (commercial)  codes  that  do  some  types  of  wire  and  transistor  sizing,  but  our  methods 
handle  several  problems  that  can  not  be  handled  by  any  previous  method.  These  include 
interconnects  with  loops,  as  in,  e.g.,  clock  meshes,  busses,  and  so  on.  While  some  problems 
of  interest  are  small  enough  to  be  handled  by  existing  SDP  codes,  some  are  very  large,  and 
will  require  new  methods  that  exploit  the  problem  structure.  This  means  that  any  effort 
in  this  area  —  exploiting  problem  structure  in  SDP  —  will  benefit  not  only  control  and 
combinatorial  optimization,  but  also,  it  seems,  VLSI  design.  Stanford’s  Office  of  Technology 
Licensing  is  currently  preparing  several  patent  applications  for  these  new  methods. 

We  have  also  continued  previous  work  [HB95,  HB96]  on  developing  fast  signal  pro¬ 
cessing  algorithms  for  the  global  positioning  system  (GPS).  A  key  problem  in  differen¬ 
tial  carrier  phase  GPS  is  the  detection  of  the  number  of  carrier  signal  cycles  between 
the  receiver  and  the  satellites  when  the  carrier  signal  is  initially  phase  locked.  The  car¬ 
rier  phase  measurements  are  linear  in  these  unknown  integer  valued  carrier  signal  cycles, 
and  the  problem  becomes  one  of  estimating  integer  parameters  in  a  linear  model.  We 
have  developed  a  theoretical  framework  for  integer  parameter  estimation  in  linear  mod¬ 
els  and  have  derived  computationally  efficient  methods  for  maximum  likelihood  estimation 
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and  verification.  These  methods  are  based  on  a  celebrated  algorithm  in  number  theory 
due  to  A.  K.  Lenstra,  H.  W.  Lenstra,  and  L.  Lovasz  [LLL82].  Previous  methods  (see, 
e.g.,  [Teu94,  Teu95,  KT96,  HWLC97,  SB97,  Teu97,  PS96])  for  integer  parameter  estimation 
and  verification  were  mainly  based  on  heuristics  and  a  precise  mathematical  justification 
was  lacking.  Our  latest  results  are  given  in  the  paper  [HB98a].  These  results  have  been  suc- 
cesfully  applied  in  spacecraft  formation  flying  using  GPS  sensing  as  reported  in  [CRA‘'‘97] 
which  was  awarded  as  the  best  student  paper  in  the  ION  GPS-97  conference.  The  proposed 
methods  for  integer  parameter  estimation  in  linear  models  are  general  and  can  be  applied  to 
applications  beyond  GPS.  These  include  radar  imaging,  magnetic  resonance  imaging  (MRI), 
and  communications.  The  paper  [MTHBC98]  describes  the  applications  of  these  methods  in 
communication  over  multi-input /multi-output  channels. 

We  have  also  developed  a  new  method  for  low-authority  controller  design.  The  premise  in 
low-authority  control  (LAC)  is  that  the  actuators  have  limited  authority  and  cannot  modify 
the  system  dynamics  by  a  large  amount.  The  main  use  of  LAC  is  in  lightly  damped  large 
structures  with  many  elastic  modes,  where  LAC  is  used  to  provide  a  small  amount  of  damping 
in  a  wide  range  of  modes  for  maximum  robustness.  Our  LAC  design  method  is  based  on 
convex  programming  (LP,  SDP,  SOCP)  and  can  therefore  deal  with  very  large-scale  problems. 
It  is  possible  to  formulate  many  different  design  specifications  such  as  eigenvalue-placement, 
robustness,  disturbance  rejection,  limits  on  feedback  gains,  static  structural  constraints,  etc. 
Also,  our  method  gives  a  powerful  heuristic  for  solving  the  actuator /sensor  selection  and 
controller  topology  design  problem  via  norm  minimization.  Currently,  we  are  finishing  a 
paper  on  the  subject  where  we  cover  the  theory,  algorithms,  and  applications  of  LAC  design. 
A  paper  on  preliminary  results  has  already  been  submitted  to  the  1998  IEEE  Conference  on 
Decision  and  Control. 

Other  related  work,  not  supported  by  AFOSR,  includes  work  on  CMOS  amplifier  design 
[HBL97a,  HBL97b],  development  of  a  new  course  on  convex  optimization  with  engineering 
applications  [BV95]. 
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